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Abstract: 

We study the thermodynamic formalism for generalized Gibbs measures, such as renormalization gronp 
transformations of Gibbs measures or joint measures of disordered spin systems. We first show existence of the 
relative entropy density and obtain a familiar expression in terms of entropy and relative energy for ’’almost 
Gibbsian measures” (almost sure continuity of conditional probabilities). We also describe these measures as 
equilibrium states and establish an extension of the usual variational principle. As a corollary, we obtain a full 
variational principle for quasilocal measures. For the joint measures of the random field Ising model, we show 
that the weak Gibbs property holds, with an almost surely rapidly decaying translation invariant potential. 
For these measures we show that the variational principle fails as soon as the measures loses the almost Gibbs 
property. These examples suggest that the class of weakly Gibbsian measures is too broad from the perspective 
of a reasonable thermodynamic formalism. 


1 Introduction 


Since the discovery of the Griffiths-Pearce singularities of renormalization group transforma¬ 
tions it has been a challenging question whether the classical Gibbs formalism can 

be extended in such a way as to incorporate renormalized low temperature phases, so that 
renormalizing the measure can really be viewed as a transformation on the level of Hamilto¬ 
nians. Later on, many other examples of “non-Gibbsian” measures appeared in the context 
of joint measures of disordered spin systems 0] , time evolution of Gibbs measures Q, and 
dynamical systems |22|, providing further motivation for the construction of a generalized 
Gibbs formalism. 


As soon as the first examples of non-Gibbsian measures appeared, Dobrushin proposed 
a program of “Gibbsian restoration of non-Gibbsian fields”, arguing that the phenomenon 
of non-Gibbsianness is caused by “exceptional” configurations, which are negligible in the 
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measure-theoretic sense. He thus proposed the notion of a “weakly Gibbsian” measure, where 
the existence of the finite-volume Hamiltonian is not required uniformly in the boundary 
condition, but only for boundary conditions in a set of measure one. This is clearly enough 
to define the Gibbsian form of the conditional probabilities, and Gibbs measures via the 
DLR equations. Since Dobrushin and Shlosman (1997), many papers have been written 
showing the “weak Gibbs” property of renormalized low temperature phases, see e.g., ||^, 

^ 1^ , and of joint measures of disordered spin systems, |n, ]^|. Parallel to this, Fernandez 
and Pfister (1997) developed ideas about generalized regularity properties of the conditional 
probabilities. They proved that the decimation of the low temperature plus phase of the Ising 
model is consistent with a monotone right-continuous system of conditional probabilities. 
In the framework of investigating regularity of the conditional probabilities, the notion of 
“almost Gibbs” was introduced in |23|. A measure /r is called almost Gibbs if its conditional 
probabilities have a version which is continuous on a set of /r-measure one. If one does not insist 
on “absolute” convergence of the sums of potentials constituting finite-volume Hamiltonians, 
then almost Gibbs implies weak Gibbs, but the converse is not true, see [^, ^|. In it is 
proved that e.g. the decimation of the plus phase of the low temperature Ising model is almost 
Gibbs, and the criterion to characterize an essential point of discontinuity of the conditional 
probabilities given in |p strongly suggests that many other examples of renormalized low 
temperature phases are almost Gibbs. The investigation of generalized Gibbs properties of 
the non-Gibbsian measures which appears e.g. as transformations of Gibbs measures is called 
the “first part of the Dobrushin program”. 


The “second part of the Dobrushin program” then consists in building a thermodynamic 
formalism within the new class of “generalized Gibbs measures”. The question whether in the 
context of weakly Gibbsian measures there is a reasonable notion of “physical equivalence” - 
i.e., if two systems of conditional probabilities share a Gibbs measure, then they are equal - is 
already raised in |Q] . In the classical Gibbs formalism, physical equivalence corresponds to zero 
relative entropy density, or zero “information distance”. Generally speaking, one would like 
to obtain a relation between vanishing relative entropy density and conditional probabilities. 
For Gibbs measures with a translation invariant uniformly absolutely convergent potential, 
a translation invariant probability measure /r has zero relative entropy density with 

respect to a Gibbs measure zz if and only if /r is Gibbs with the same potential. Physically 
speaking, this means that the only minimizers of the free energy are the equilibrium phases. 
In complete generality, i.e. without any locality requirements, = 0 does not imply 

that /i and u have anything in common, see e.g. the example in where a measure u is 
constructed such that for any translation invariant probability measure h{fi\iy) = 0 . 

In this paper we investigate the relation between h{n\iy) = 0 and the property of having a 
common system of conditional probabilities for general quasilocal measures, almost Gibbsian 
measures and weakly Gibbsian measures. We will work in the context of lattice spin systems 
with a single-site spin taking a finite number of values. Let 7 denote a translation invariant 
system of conditional probabilities, and Qimil) the set of all translation invariant probability 
measures having 7 as a version of their conditional probabilities. If 7 is continuous then, for 
^ G Qmvil)-, we obtain /i(/r|z^) = 0 if and only if /r G If 7 is continuous //-almost 

everywhere, then we obtain that = 0 and v G f/inv( 7 ) implies /t G Qmvil)- More 

generally, for v G Qinwil) and // G concentrating on a set of “good configurations”, 
we obtain the existence of h{^\v), an explicit expression for it where v enters only through 
its conditional probabilities and the relation h{^\iy) = 0 implies // G Gimil)- The “good 
configurations” here are defined such that a telescoping procedure - inspired by the method 
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of Sullivan - converges almost surely. These results, together with some examples of 
non-Gibbsian measures to which they apply show that almost Gibbsian measures exhibit a 
reasonable thermodynamic formalism. The fact that some concentration properties of the 
measures are required is reminiscent of the situation in unbounded spin systems, an analogy 
already pointed out by Dobrushin, p^] . 

The context of joint measures of disordered spin systems provides a good source of ex¬ 
amples for validity and failure of the variational principle. Here by joint measure we mean 
the joint distribution both of the spins and the disorder. In these examples (especially for 
the random field Ising model) there is a precise criterion separating the almost Gibbsian case 
from the weakly Gibbsian case. In particular, for the random field Ising model, the joint 
measure is always weakly Gibbs, and at low temperatures we prove here that it even admits 
a translation invariant potential which decays almost surely as a stretched exponential (so in 
particular converges absolutely a.s.). If there is no phase transition, then the joint measure 
for the random field Ising model is almost Gibbs (but not Gibbs in dimension two at low 
temperature). In the almost Gibbsian regime we obtain the variational principle whereas in 
the weakly but not-almost Gibbsian regime we show the invalidity of the variational principle. 
More precisely, in that case the joint measure for the minus phase {K~) is not consistent with 
the (weakly Gibbsian) system of conditional probabilities of the plus phase but one 

easily obtains that the relative entropy densities h{K~\K~^) = h{K~^\K~) = 0. Physically 
speaking, this means that we are in the pathological situation where a minimizer of the free 
energy is not a “phase” (in the DLR sense). At the same time, we also treat the joint mea¬ 
sures in a very broad sense, i.e., for possibly non-i.i.d. disorder, we prove existence of relative 
entropy density, give an explicit representation in terms of the defining potentials, and discuss 
implications of our results for the Morita approach |26]. 

Our paper is organized as follows: in Section 2 we introduce basic definitions and notations, 
discuss the different generalized Gibbs measures and define the variational principle. In Section 
3 we prove the variational principle for some class of almost Gibbsian measures, using the 
technique of “relative energies” of Sullivan |30|. In Section 4 we prove the variational principle 
for measures with translation invariant continuous system of conditional probabilities. In 
Section 5 we give the example of the GriSing random field and the decimation of the low- 
temperature plus phase of the Ising model. In Section 6 we discuss the examples of joint 
measures of disordered spin systems. 


2 Preliminaries 

2.1 Configuration space 

The configuration space is an infinite product space Q = with E a finite set. Its Borel-cr- 
field is denoted by T. We denote byiS = {AcZ'^,|A| <oo} the set of the finite subsets of 
and for any A £ S, Qa = E^. Ta denotes the cr-algebra generated by {cr(x) : x £ A}. For all 
cr,a; G H, we denote gai^a the projections on Ha and also write ctacuac for the configuration 
which agrees with cj in A and with u) in A^. The set of probability measures on (H, E) is 
denoted by Alj*". A function / is said to be local if there exists A £ S such that / is Ea- 
measurable. We denote by £ the set of all local functions. The uniform closure of C is C'(H), 
the set of continuous functions on H. 

On H, translations {tx : x £ are defined via {TxU)){y) = uj{x + y), and similarly on 
functions: Txf{uj) = and on measures f fdxxfJ- = f{Txf)dfi. The set of translation 
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invariant probability measures on Q is denoted by A^^’inv 

We also have a partial order: rj < C, ii and only if for all x G r]{x) < ((x). A function 
/ : 17 — > M is called monotone if t] < ( implies /(??) < /(C)- This order induces stochastic 
domination on : fi ^ ly if and only if ^(/) < J^(/) for all / monotone increasing. 


2.2 Specification and qnasilocality 

Definition 2.1 A specification on is a family 7 = { 7 a,A G 5} of probability kernels 

from Hac to T that are 

1. Proper.- For all B G ^\{B\u)) = 1b(w). 

2. Consistent.- //A C A' are finite sets, then 7a'7a = 7A'- 


The notation 7a'7a refers to the composition of probability kernels; for yl G w G 17: 

(7A'7a)(A|w) = / 7a(A|(u')7A'((^^V)- 

Jn 

These kernels also acts on bounded measurable functions /: 


7a/(w) 


f{(^hA{d<j\<yj) 


and on measures /u: 


M7a(/) = 


fdnjA 


j {lAf)dn. 


A specification is a strengthening of the notion of a system of proper regular conditional 
probabilities. Indeed, in the former, the consistency condition (2) is required to hold for every 
configuration w G 17, and not only for almost every cj G 17. This is because the notion of 
specification is defined -without any reference to a particular measure. A specification 7 is 
translation invariant if for all A G .F, A G 5, cu G 17: 


7a+x(A|w) = 7A(rj,A|rrw) 


In this paper we will always restrict to the case of non-null specifications, i.e., for any A G 5, 
there exist 0 < oa < f^A < 1 such that 


OA < inf7A(fT|77) < sup7A(iT|r/) < 6 a. 

ij,7] 


Definition 2.2 A probability measure jj, on (17, F) is said to be consistent with a specification 
') (or specified by j) if the latter is a realization of its finite-volume conditional probabilities, 
that is, if for all A £ F and A € S, and for pL-a.e. oj. 


pL[A\FAc]{ijj) = 7a(A|(j). 


(2.3) 


Equivalently, p, is consistent with 7 if 


j i7Af)dfi = j 


fdp, 


for all / G (7(17). We denote by ^( 7 ) the set of measures consistent with 7 . For a translation 
invariant specification, l?inv( 7 ) is the set of translation invariant elements of ^( 7 ) . 
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Definition 2.4 1. A specification 7 is quasilocal if for each A G 5 and each f local, 

7 a / g c{n). 

2 . A probability measure p is quasilocal if it is consistent with some quasilocal specification. 

2.3 Potentials and Gibbs measures 

Examples of quasilocal measures are Gibbs measures defined via potentials. 

Definition 2.5 1. A potential is a family = {$^4 : A G 5} of local functions such that 

for all A € S, $^4 is ipA-measurable. 

2. A potential is translation invariant if for all A ^ S, x a and uj € Q: 


Definition 2.6 A potential is said to be 

1. Convergent at the configuration lo if for all A G S the sum 

^ 4>a(w) 


is convergent. 

2. Uniformly convergent if convergence in is uniform in oj. 

3. Uniformly absolutely convergent (UAC) if for all A G S 

sup|4>a(w)| < 00 . 

AnA^0 


(2.7) 


For a general potential <1>, we define the measurable set of its points of convergence: 

= {a; G P : 4* is convergent at w}. 

In order to define Gibbs measures, we consider a UAC potential and define its finite-volume 
Hamiltonian for A G S and boundary condition a; G P by 

H%{a\Lo) = 4>A(o-Aa;Ac). 

AnA^0 


Definition 2.8 Let be UAC. The Gibbs specification 7 ^ with potential is defined by 

1 


7A(f^l^^) = 


Za(' 




UJ 


where the partition function (u/) is the normalizing constant. 

A measure pis a. Gibbs measure if there exists a UAC potential <1> such that p G ^( 7 ^). Gibbs 
measures are quasilocal and conversely, any non-null quasilocal measure can be written in a 
Gibbsian way (see |14| and more details in Section 4). 
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2.4 Generalized Gibbs measures 


Definition 2.9 A measure v is weakly Gibbs if there exists a potential such that = 1 

and 

i' [o-A|.iGv=] (w) = ^ 

zXiuj) 

for u-almost every u). 


Remark 2.10 Some authors insist on the almost surely absolute convergence of the sums 
defining However, for the definition of the weakly Gibbsian specification there is no 

reason to prefer absolute convergence. 

Definition 2.11 Let 7 be a specification. A configuration lo is said to be a point of continuity 
for 7 if for all A G S, f £ C, 7 a/ is continuous at u. 


For a given 7 , denotes its measurable set of points of continuity. 

Definition 2.12 A measure v is called almost Gibbs if there exists a specification 7 such that 
y £ Qiri) and v{Gt,.f) = 1 . 


If v is almost Gibbs, then there exists an almost surely convergent potential d> such that 
v is weakly Gibbsian for and thus almost Gibbsianness implies weak Gibbsianness. The 
converse is not true: a measure can be weakly Gibbs and for the associated potential <I>, 
is of measure zero |]^ , ^|. If a measure is almost Gibbs and translation invariant, then the 
corresponding potential can be chosen to be translation invariant. 


2.5 Relative entropy and variational principle 


For 

defined as 


the finite-volume relative entropy at volume A £ S of p. relative to y is 


hA{h\y) = < 


/ 

Jn 


djUA dp. A 


log -— dy if PA < yA 


dyA dvA 


(2.13) 


+00 otherwise. 

The notation pA refers to the distribution of oja when oj is distributed according to p. By 
Jensen’s inequality, hA{p\y) > 0. The relative entropy of p relative to y is the limit 


h{p\u) 


lim 

n —»'00 


ra'*''"*"'"* 


(2.14) 


where = [n, n]'^ n Z'^ is a sequence of cubes (this can be replaced by a Van Hove sequence). 
In what follows, if we write \\m.A^j,d /(A) we mean that the limit is taken along a Van Hove 
sequence. The defining limit ( |2.14| ) is known to exist if G -^I'inv ^ translation invariant 
Gibbs measure with a translation invariant UAC potential and p £ arbitrary. The 

Kolmogorov-Sinai entropy h{p) is defined for p £ 

h{p) = - lim T^y'L(c^A„)log/i(cJA„). (2.15) 


We are now ready to state the variational principle for specifications and measures, which 
gives a relation between zero relative entropy and equality of conditional probabilities. 
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We say that a 


Definition 2.16 Let ^ be a specification, u G Gmvi'j) and M. c 
variational principle holds for the triple ( 7 , 1 /, At) if 

( 0 ) h{pi\u) exists for all pi ^ M. 

(1) /U G Qi-cw{l) n M implies h{pL\v) = 0. 

(2) h{pi\i/) = 0 and pt £ Ai implies pi G ^inv(7)- 

Items (1) and (2) are called the first and second part of the variational principle. The second 
part is true for any translation invariant quasilocal measure u (with Ai = The 

first part is proved for translation invariant Gibbs measures associated with a translation 
invariant UAC potential (with AA. = also). We extend this result to any translation 

invariant quasilocal measure in Section 4. In Q, the second part has been proved for some 
renormalized non-Gibbsian FKG measures. In general, the set Ai will be a set of transla¬ 
tion invariant probability measures concentrating on “good configurations” (e.g., points of 
continuity of conditional probabilities). 

3 Variational principle for generalized Gibbs measures 

We study the variational principle for generalized Gibbs measures. We first prove the second 
part for almost Gibbsian measures, which is a rather straightforward technical extension of 
Georgii (1988), Ghapter 15. 

3.1 Second part of the variational principle for almost Gibbsian measures 
Theorem 3.1 Let 'j he a translation invariant specification on {LI, A) and v G Qirwil)- For 


all p. G A1+ 



and thus such a measure p is almost Gibbs w.r.t. 7 . 

Proof. Choose v G Qmv{l) and p such that h{p\i/) = 0. We have to prove that for any 
g G C,, A G S'. 

l{7a9 - 9 ) = 0- (3.2) 

Fix g £ C and A £ S such that g is AA-measurable. The hypothesis 



(3.3) 


implies that for every A £ S, the density /a = 7 ^ exists and is a bounded positive 
measurable function. Introduce local approximations of 'yA9' 


9n{<^) = inf 7Aff(f^A„WA-) 

ff+(cj) = sup7Aff(cTA„a;A-)- 
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In the quasilocal case, we have Qn ~ 9n ^ ^ uniformly when n goes to infinity, whereas here 
we have — g~ ^ 0 on the set of /r-measure one, and hence, by dominated convergence 
in L^(/i). To obtain (3.2) decompose: 


^'i'lAg ~ g) — + Bn + Cn + Dn (3-4) 

where 


Using 


An = KlA9-9n) 

Bn = v{{gn - 7A5')/a„\a) 
Cn = l^(/A„\A(7Afi'- 5 )) 
Dn = i^((/A„\A - /a„)5)- 

0 < 7A5 - 5n < - 9n 


An ^ 0 as n goes to inhnity. For Bn, use 


0 < \Bn\ = V ((tAS- - 9n )/a„\a) < Z^(/A„\A(5'n “ fi-n )) = /^(^n “ 9n ), 
to obtain Bn —> 0 as n —>■ oo. 

Since G ^( 7 ), and /a„\a ^ Da^, Cn = 0. The fact that Dn —> 0 follows from the 
assumption of zero relative entropy density: see Georgii (1988), p 324. 


Remark 3.5 1. The role of A4 in Definition 2.16i is played here by the set of measures 

concentrating on the points of continuity of j (n £ M if and only if = 1). 


2. Remark that in Theorem 3.1, we do not ask any concentration properties of v. 


3.2 First part of the variational principle for some almost Gibbsian mea¬ 
sures 

To obtain the first part of the variational principle, it will turn out that concentration of [i 
on the set 11.^ is not the right condition. We need that some particular class of “telescoping 
configurations” are points of continuity of the specification. This reminds of asking continuity 
properties of the one-sided conditional probabilities. In the case of (uniformly) continuous 
specifications, this distinction between one-sided and two-sided is of course not visible. 

We choose a particular value written -|-1 in the state space E and denote by the 
configuration whose value is -|-1 everywhere. To any configuration cj G 11, we associate the 
configuration defined by 

{ (j{x) if X < 0 
+l if X > 0 . 

Here, the order < is lexicographic. We define then to be the subset of H of the configu¬ 
rations a such that the new configuration is a good configuration for 7 : 

= {cr G CJ+ G Q.y}. 

This set will be described in different examples in Section 5. 
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3.2.1 Results 


We consider a pair ( 7 , v) with u G and a measure fu, which satisfies the following con¬ 

dition: 

Condition Cl 

) = 1 - 

We also introduce 

whenever it exists. 

Theorem 3.6 Under the condition Cl: 

1 . h{pi\u) exists if and only if ef exists and then 

h{ii\v) = e-^ - h{^i) - f ^ n{da). (3.7) 

Jn 7o(+k+) 

where h{fi) is the Kolmogorov-Sinai entropy of p,. 

2. If moreover jj, G Qinvil) and ef exists, then 

h{p,\i/) = lim — log . ( 3 . 8 ) 

ATZ^ |A| u {+ a ) 

To get the more usual expression of the variational principle, we add an extra condition to 
the condition Cl; 


Condition C2 


h & Q\nv{l) is such that 


lim log 

ATZd |A| 


a(+a) 

^(+a) 


= 0 . 


Theorem 3.9 Assume that conditions Cl and C2 are fulfilled. Then 


1. h{fj,\i') = 0. 

2. ef exists and ef = e+. 

3. h{a\n) exists for all a G satisfying Cl. 

As a corollary of these theorems, we obtain the usual first part of the variational principle. 

Theorem 3.10 Let p, G and v G Q\w{c) such that conditions Cl and C2 hold and ef 

exists. Then 


1. h{fj,\i') exists. 

2. fi & Qinvil) implies h{pi\u) = 0. 

Remark 3.11 The existence of the limit defining efi is guaranteed for e.g. renormalization 
group transformations of Cibbs measures, and for u with positive correlations (by subadditiv¬ 
ity). Moreover, in the case of transformations of Cibbs measures, condition C2 is also easy 
to verify. See Section 5 below. 
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3.3 Proofs 


Proof of Theorem |3.6| 


First we need the following 


Lemma 3.12 If = 1 , then 


1. Uniformly in lo 


lim 

n—>oo 




7An(c^l^) 

7A„(+|c^) 


fj.{da) 



7o((T+|o-+) 

7o(+k+) 


fi{dcr). 


2. For V € 0(j), 


lim 

n—^oo 




^( 0 'A„) 

^(+A„) 


fi{da) 



7o(o-+|cr+) 

7o(+k+) 


fi{da). 


In particular, the limit depends only on the pair ( 7 ,^). 


Remark 3.13 If fa is ergodic under translations, we have a slightly stronger statement for 
^ ■ PQ In ^og 7 a(+M converges in Li(/r) to log uniformly in 

uj G P. 


Proof 

1. The proof uses relative energies as in Sullivan (1973). For all A G 5, cr, a; G P, we define, 

E+{a\uj) = log and D{a) = E+^{a\a) = log 

We consider an approximation of (T'*“ at finite volume A with boundary condition lu and 
define the teleseoping eonfiguration Tfl[x,a, +]: 


Tfl[x,a, +]{y) 


w(y) 

if 

y 

G A'^ 


c^iv) 

if 

y 

< x, 

y G A 

+1 

if 

y 

> x, 

y G A. 


Using the consistency property of 7 , we have by telescoping, 

E+ia\u;) = Y,Et{^\Tn^,^,+])- 

x&A 

By translation invariance of 7 , 

U|((T|a;) = '^D{T-,rTX[x,a, +]). 
xeA 
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By translation invariance of iJ,, 


IQ 


I^D{T-^TX[x,Txa,+])n{da). 

xeA„ 


IQ 


Therefore, we have to prove that, uniformly in cu, 
/ 

1 


lim 

n^oo |A^ 


Y / --D(CJ+) ^(do-) =0. 


KxeAr, 


IQ L 


By definition, 


T-xT^Jx,Tx(J,+] = < 


T-xU){y) 

if 

y + X G A^ 

+ 

if 

0 <y,y + xGA, 

. cr(y) 

if 

y < 0, y + X G A, 


Now, pick e > 0, u; G O and a G Using the fact that a~^ is a point of continuity 

of D, we choose no such that ^|a„(, = o'''~|a„q implies |D(^) — D{a'^)\ < e. Remark 
that T-xT‘^ [x,ra;CJ, +] and a~^ differ only on the set {y G : x + y G A^}. Therefore, 
the difference \D{a~^) — D{t-xT^ [x,TxO', +])| can only be bigger than e for x such that 

(Ano — x) n A^ 7 ^ 0. 

Therefore, 


|A 


n| Y [■^('^-^^A„[a;,7-a;CJ,+]) - T>(o-+] 


CG An 


< e + 


|A„ 


D 


{x G A„ : {Ano - x) n a;^ / 0 } 


and this is less than 2e for n big enough. So we obtain that 

o| Y [■^('^-*^A„[a^>'^xO-,+]) - A»(CJ+)] 


|A. 


XGAr, 


converges to zero on the set of of full ^-measure, uniformly in ui. By dominated 
convergence, we then obtain 

lim sup-^ [ I ^ [D{T-xT^[x,TxCr,+]) - D{a+)] fi{da) = 0 

n-oo ^ 


which implies statement 1 of the lemma. 
2. Denote 




1 


Using n G G('y), we obtain 


FaAi^,v) = 


lA I / logU7T^^(^^)- 
|An| JQ ^^(+A„j 

/n7A„(o-|w)n((iw) 


log 


\K\Jq 47A„(+|u;)i^(dw) 


fi{da). 
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Use 


. n 7A„(^|c^) ^ ^ 7AjcT|a;) 

a;en 7A„(+|a;) “ 7A„(+|a;)z/(dw) “ ..en 7A„(+|w)' 

Let e > 0 be given and co = uj{n, a, e), lo' = uj'{n, cr, e) such that 



inf log 
tjeo 


7A„(o~|^) 

7A„(+|w) 


^{da) > 


f , „ 7A„(o~|^(n,o-,e)) 

Jn SAj+|c^(n,a,e)) 


e 


and 


/ 

Jn 


, 7 a„(ct|w) 

sup log- —-7 


/i(d(T) < / log 
Jn 


7A„(o-|a;'(n,fT, e)) 


+ e. 


7A„(+|w'(n,cj, e)) 

Now use the first item of the lemma and choose N such that for all n > N, 


sup 

U) 


1 


log ^ I ^ fj,{da) — [ D{a~^)fj,{da) 


l^n| Jn 7 A„(+|w) 


in 


< e. 


For n > N, we obtain 

[ D{a^)fi{da)-2e < Fa„(/u|j/) < [ D{a^)fi{da) + 2e. 


Proof of Theorem 


3.6 


1. Denote 


hn{fJ-W) 



^/x(o-A„)log 


O'Ar, 


f^(UAj 

^^(UA„)' 


We recall that for /j. G the limit of hn{fJ,) := -|^ /^(uA„) log/i(crA„) is 

the Kolmogorov-Sinai entropy of p. denoted /i(/u). We write 


hn{gi\v) 


hnitl) 



^/x(o-A„)log 




n 


^(UA„) 

l^i+An) 



logZ^(+A„). 


When condition Cl holds, the asymptotic behavior of the second term of the r.h.s. is 
given by Lemma 3.12. Hence, the relative entropy exists if and only if exists, and it 
is given by (3.7). 


2. We consider // G Qinvil) such that = 1 and use the following decomposition of 

the finite-volume relative entropy: 


hn{lJ-\v) = 

' ' rr K 


/^(UA„) 

/^(+A„) 



^//(cJA„)log 

°'An 




+ 



(3.14) 
K + An) 

^(+A„) 


By Lemma |3.12 , in the limit n — 00 , the first two terms of the r.h.s. are functions of 7 
rather than functions of /r, G Q\nv{l) and cancel out. Hence, the relative entropy exists 
if and only if the third term converges. Using Item 1 (existence of relative entropy), we 
obtain the existence of the limit (3.8) and the equality 


h{n\v) 


lim —— 

n —>00 I An 


log 


f^(+A„) 

^^(+A„) 
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Proof of Theorem |3.9| 


1. This is direct consequence of Theorem 3.6 and (3.8): under the conditions Cl and (72, 
h{^\v) = 0 . 

2. The existence of the relative entropy proves that exists and is given by 

70 (cr+1 cr+) 


h{n) + J 


log 


7o(+k^ 


-fi{da). 


Combined with C 2 this proves e))) = e^. 

3. Consider any other measure a £ Ait- such that Cl holds. The existence of the relative 

i,inv _ 

entropy h{a\^) follows by combining the existence of with Theorem and 
h{a\v) = e+ - h{a) - J log 

If moreover a satisfies C2, we also obtain that e+ exists and equals e+. 


3.4 Generalization 

In the hypothesis of the theorems above, the plus-configuration plays a particular role of 
telescoping reference configuration. Without too much effort, we obtain the following gen¬ 
eralization where we telescope w.r.t a random configuration ^ chosen from some translation 
invariant measure A. Results of the previous section are recovered by choosing A = The 
generalization to a random telescoping configuration will be natural in the context of joint 
measures of disordered spin systems in Section 6 . 

For any cr € fl, we define the concatenated configuration a^: 

f cr(x) if X < 0 

Vx G Z'^, cr^(x) = I 

( ^(x) if X > 0 . 

and the set to be the subset of x of the configurations (u, such that the new 

configuration is a good configuration for 7 : 

= {(fj,.^) G n X n, (7^ G n..),}. 

We also generalize ejji and denotes 

e^ = - lim f logzz(^A)A(dO (3-15) 

ATZd \A\ Jq 

provided this limit exists. 

We consider a specification 7 , measures u G Qirwil): /^, A G and the following 

conditions: 

CT A®/i(S4^’<°) = 1. 

C’2 ^ /n (log Ji){J^)A(<i{A) = 0. 
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The following theorems are the straightforward generalizations of Theorem 
their proofs follow the same lines. 

Theorem 3.16 Under the condition C’l, 

1 . exists if and only if e^ exists and then 

HuH = - Hu) - [ log fj,{da)X{dH- (3.17) 

Jnxn 7o(C|o-^) 

2. If moreover ^ G ^inv ( 7 ) and exists, then 

h{ix\u) = f (logj^)(CA)A(dCA)- 

Theorem 3.18 Consider G ® specification, v G Ginvil) such that exists and 

conditions C’l and C’2 are true. Then 

1. h{yL\v) exists and is given by i\3.17 ). 

2 . fvG GinvH) implies h{pH) = 0 - 


B.t and 3.10|, and 


4 Variational principle for quasilocal measures 


The usual way to prove fj. G QimH) Hu\H = 0 in the Gibbsian context uses that 7 
is a specification associated with a translation invariant and UAC potential and goes via 
existence and boundary condition independence of pressure (see |11]). Since for a general 
quasilocal specification 7 we cannot rely on the existence of such a potential (see 0 and 
open problem in | 0 ), we show here that the weaker property of uniform convergence of the 


vacuum potential which can be associated to the quasilocal 7 (see |14|) suffices to obtain zero 
relative entropy. 


Theorem 4.1 Let ^ he a translation invariant quasilocal specification, v G QmvH) and /a G 
M-Hnw- '^hen h{iJL\v) exists for all p G and 

P G GinvH) HuW) = 0- 


Proof. The implication of the left [the second part) is proved in |]T]. To prove the first part, 
we need the following lemma to check hypothesis of Theorem |3.1C . Condition C2 is trivially 
true when 7 is quasilocal (17^*^ = 17). 


Lemma 4.2 

and 


P,i^ ^ GinviH with 7 translation 


lim 


1 -log^^ 


iiili - - 

n^oo |A„| n{+Aj 


invariant and quasilocal, 

= 0 . 


p-r p-i 


exist 
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Proof. Kozlov (1974) proves that to any translation invariant quasilocal specification 7 there 
corresponds a translation invariant uniformly convergent vacuum potential <h such that 7 = 

7 • 

By uniform convergence, we have 


lim sup 

ATZ'* (T 




= 0 . 


(4.3) 


Remark that in ( |4.3| ), the absolute value is outside the sum, i.e., ( |4.3| ) means that the series 
1 ^^ 490 convergent in the sup-norm topology on C'(n), but not necessarily absolutely 
convergent. We can define a Hamiltonian and a partition function for any A G 5, r^, a € as 
usual: 

^a(^)= ^a{o-aVA-) and Za{uj) ='^ (4.4) 

AnA7^0 (TGrj 

Lemma is now a direct consequence of the following 


Lemma 4.5 1. 


2 . 


lim sup -j—— 

aj,77,c7 \-^n 


HlJa) - HX^{a)\ = 0. 


1- 1 1 Za„{uj) 

hm sup-—log 

Cj.r? |A„| ZA„[r]) 


= 0 . 


(4.6) 


(4.7) 


Proof. We follow the standard line of the argument used by Israel (1986) to prove existence 
and boundary condition independence of the pressure for a UAC potential, but we detail it 
because the vacuum potential is only uniformly convergent. Clearly, (|4.6| ) implies (^^): for 
all n G N, 


ZaM 


exp I - sup HlJa) - H^Ja) | < sup < exp | sup Hlja) - | 


^Aniv) 


a;,r?,(T 


To prove (4.1), we write 


^A„(^) -^A„(^) = Y1 ^A(f^A„^A=) - ^A(f^A„WA5i) 

AnA„^ 0 ,AnAc ^0 


and we first remark: 
1 


|A. 

We obtain 


<^A{(TAr,VA-J - $a(o-A„WA-) 

AnA,i^0,AnA=7^0 


' xeAn A9a:,AnA=7^0 


sup 


Y 

A9x,AnA=^0 


|^ 4 > a ( o -) - Y 

A^x A93:,AcA^ 

|^4>A(Ta;0-) - Yj ^a{Tx(t] 
Ago A30 ,Ac(A„-x) 


< sup 




^ A3O,An(A„-a:)'=^0 
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Pick e > 0 and choose A such that 


sup 


E 


^ A3O,AnA'=^0 


< e 


then 


where 


E 

ABQ,Ar\{Kn-xY^% 


< 


e if (Aji — x) D A 

C if (An - x) n ^ 


C = sup|E^a(0 


AsO 


< oo. 


Since for any A C finite, 


J{x:A + xnA;# 9 }|^^ 

n^oo I An I 


< e 


we obtain 

lim STTn 

x£An ^ 'x9x,AnA^^0 

which by the arbitrary choice of e > 0 proves (|4.6|) and the statement of the lemma. 


lim sup E E 


To derive Lemma [4.2| from Lemma 4^ , we only have to prove that for all u G ( 7 ), e 

exists and is independent of 7 . For such a measure u, write 


J^(+a) — 


e~^^n (+) 


^{drf) 


In ^A„(f/)) 

where is defined via the vacuum potential of 7 in ( [4.41) . We use Lemma 4A to write 


i+A) = [ 

Jn 


n ZX 


-v{dT]) 


where oa — &a means liiUA | log | = 0. Since $ is the vacuum potential with vacuum 
state +, Lf^(+A) = 0 and hence 

i-(+a) = (Z+)-' = (Zj”)-' = [ exp(- $.4(p))^ 


ctGQa 


AcA 


-1 


where (resp. is the partition function with + (resp. free) boundary condition, which 

in our case coincide. Fix R > 0 and put 

: = 4>a(c’') if diam(A) < R 
= 0 if diam(A) < R 

then, using existence of pressure for finite range potentials, cf. |R], 

lim^logZf""($('^)) :=P($(«)) exists. 
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Now use 


log 


E.expi-EAcAi’lf’M) 


< 

sup 


E 

$^(cr) 



cr 

AcA,diam(A)>R 



< 

sup^ 

E 

^a{ 

O') 


u 

X 

eA 

A93:,diam(A)>R 


< 

^sup 

E 


O') 


icGA 

u 

A93:,diam(A)>R 


= 

A sup 

E 

l>yl(cr) 


and 


E,e=<p(-E.4CA<'(<^)) 

-AcA^Sf'’W) 


< |A| sup 


E,7exp(-E 

to conclude that R > 0} is a Cauchy net with limit 

lim = lim log 

R^oc |A| 


yl90,diam(A)>R 

A90,diam(A)>R/\ R^ 


which depends only on the vacuum potential (hence on the specification 7 ). This proves that 
e+ and e+ exist for all € ^inv( 7)5 and depends of 7 only. Therefore, 


lim A. log = e'^ — = 0 


|A| z^(+a) 


"M 


which proves Lemma 4.2 


A direct consequence of this lemma is that in the framework of Theorem |4.1| , exists 

and conditions Cl and C2 are true. We obtain the theorem by applying Theorem ■ 


5 Examples 

5.1 The GriSing random field 

The GriSing random field is an example of joint measure of disordered systems, studied in 
more extent in Section 6. It has been studied in Q and provides an easy example of a non- 
Gibbsian random fields which fits in the framework of our theorems. The random field is 
constructed as follows. Sites are empty or occupied according a Bernoulli product measure 
of parameter p < Pc where pc is the percolation threshold for site percolation on Z*^. For any 
realization rj of occupancies where all occupied clusters are finite, we have the Gibbs measure 
on configurations a € { — 1,+!}^'* 

p^ida) 

which is the product of free boundary condition Ising measures on the occupied clusters. More 
precisely, under spin configurations of occupied clusters C are independent and distributed 
as: 
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The GriSing random field is then defined as: 

^(x) = a{x)r]{x). 

In words, ^(x) = 0 for unoccupied sites and equal to the spin a{x) at occupied sites. 

We denote by the law of the random field 

It is known that for any p G (0,1), (5 large enough, is not a Gibbs measure (see |^] 
for p < Pc and |]l^ for any p G (0,1)). The points of essential discontinuity of the conditional 
probabilities .Iilp,/ 3 (< 7 ( 0 )|^gd\|Qj.) are a subset of 

D = {^ : ^ contains an infinite cluster of occupied sites}. 

Since p < pc, there exists a specification 7 such that {Kp^p} = ^( 7 ) and such that for the 
continuity points we have Kp^j^{Q,^) = 1, i.e., Kp^p is almost Gibbs. Moreover, if we choose 
^0 = 0 as a telescoping reference configuration, then clearly a G D'^ implies G i.e., 
in this case Qj C Therefore, in this example condition Cl is satisfied as soon as p 

concentrates on D^. Using {Kpp} = (/(y), and 

lim -^logKp,^( 0 A) = log(l -p) 

Atzd |A| 

we obtain the following proposition: 

Proposition 5.1 If p{D) = 0 then h{p\Kp^p) exists and is zero if and only if p = Kp,p- 


5.2 Decimation 


Let p'p (resp. pp) be the low-temperature (/3 > Pc) plus (resp. minus) phase of the Ising 
model on Z'^. For 6 G N, denotes its decimation, i.e., the distribution of {a{bx) : x G Z'^} 
when cr is distributed according to p'p. It is known that Up is not a Gibbs measure |P| . In |]T^] 
it is proved that there exists a monotone specification such that Vp G ^( 7 ^). In it is 
proved that the points of continuity U..|,+ satisfy v~p{Q.^+) = 1 , i.e., v~p is almost Gibbs. The 
point of continuity of 7 + can be described as those configurations rj for which the “internal 
spins” do not exhibit a phase transition when the decimated spins are fixed to be t]. E.g., the 
all plus and the all minus configurations are elements of , but the alternating configuration 
is not. 


The first part of the variational principle for has already been proved in |^] 

(and is direct by Theorem ^), with a set M consisting of the translation invariant measures 
which concentrate on 0..^+ . Here we complete this result by adding a second part: 


Theorem 5.2 For any p G satisfying Cl for 7 +, 


1 . h{p\v) exists. 

2. We have the equivalence 


P G Qirwil^) 


h{p\v^) = 0 . 


We first use a lemma. 


18 



(5.4) 


Lemma 5.3 /i G ^( 7 ^) and = 1 implies 

^ ^ ^ Vp- 

Proof. Consider / monotone. By monotonicity of 7^ jl^ , for all A G 5, 

[ f dp = [ {-ftf ){uj)p{duj) < [ {'ytf ){+)pidaj) = 

J J Q, J Q, 

Taking the limit A I Z'^ gives, and using 7 )y('|+) goes to 

j fdp < j fdu^. 


Similarly, using = 1, and the expression of n.y in |]T|, we have 7 ^(/) = 7 (/), /U-a.s. 

and hence 


which gives 


fdp= j 7a(/)^M > 7a/(-) 
[ fdp > f fdu~. 


The following corollary proves Theorem |5.2| using Theorem 3.10 
Proposition 5.5 1. = — lim^i^d log r'^(+A) exists. 

2. For any p G 


V ^ 1 /^(Aa) n 

hm — log -- = 0 . 

ATZ''|A| z^J(+a) 


Proof. 


1. Follows from subadditivity and positive correlations. 

2. Follows from stochastic domination ( |5.4D and 

,. 1 , 1^^{+a) V 1 , IJ-pi+bA) 

hm — log -- = hm — log -- = 0 

ATZd |A| n^{+A) ATZrf |A| Pisi+bA) 

where, to obtain the last equality, we used that Pp,Pp are the Ising plus and minus 
phases. 


Remark 5.6 ITe conjecture that Cl is satisfied for any ergodic measure p G ^( 7 "’") in dimen¬ 
sion d = 2. This amounts of to prove that the internal spins do not show a phase transition, 
given a “typical configuration of p ” on 5Z'^ to the left of the origin, and all + on bTJ^ to the 
right. Fixing these decimated spins acts as a magnetic field, pushing the spins on the right 
of the origin into a “plus-like” phase and the spins on the left of the origin in a “plus-like” 
or “minus-like” phase, depending on p. The location of the interface between “right and left” 
should not depend on the boundary condition in d = 2 (no Basuev transition). However, we 
do not have a rigorous proof of this fact. 
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6 Examples II: Joint measure of random spin systems 


We consider the joint measures of disordered spins-systems on the product of spin-space and 
disorder-space defined in terms of a quenched absolutely convergent Gibbs-interaction and 
an a priori-distribution of the disorder variables. They were treated before in and 

provide a broad class of examples of generalized Gibbs measures. A specific example of this, 
the GriSing field, was already considered in Section 5.1. 

First we prove that, for the same quenched potential, the relative entropy density between 
corresponding, possibly different joint measures is always zero. Next we prove in generality 
that these measures are asymptotically decoupling whenever the a-priori distribution of the 
disorder is. The useful notion of asymptotic decoupled was recently coined by Pfister (2002), 
and provides a broad class of measures, including local transformations of Gibbs measures, 
for which the existence of relative entropy density and the large deviation principle holds. 
Using results these results, we easily obtain existence of the relative entropy density. Next 
we specialize to the specific example of the random field Ising model in Section 6.3. We 
focus on the interesting region of the parameter space when there is a phase transition for 
the spin-variables, for almost any configuration of disorder variables. Here we show on the 
basis of [^] that the joint plus and the joint minus state for the same quenched potential are 
not compatible with the same interaction potential. In it was already shown that there 
is always a translation-invariant convergent potential, or a possibly non-translation-invariant 
absolutely convergent potential for the corresponding joint measure. We also discuss this in 
more detail and sketch a proof on the basis of ||18|| and the RG-analysis of Bricmont and 
Kupiainen (1988) that shows that there is a translation-invariant joint potential that even 
decays like a stretched exponential. This provides an explicit example of a weakly (but not 
almost) Gibbsian measure for which the variational principle fails. 


6.1 Setup 


We consider disordered models of the following general type. We assume that the configuration 
space of the quenched model is again as detailed in Section 2.1 and we denote the spin variables 
by a. Additionally we assume that there are also disorder variables ry = entering the 

game, taking values in an infinite product space {E')^ , where again E' is a finite set. We 
denote the joint variables by ^ = {^x,Vx)x£Z‘^- It will be convenient later 

also to write simply (arj) to denote the pair (cr, r/). 


One essential ingredient of the model is given by the defining potential <I> = 
depending on the joint variables ^ = {cr,r]). <hA(0 depends on ^ only through ^a- We assume 
that <1> is finite range. When we fix a realization of the disorder rj, we have a potential for the 
spin-variables a that is typically non-translation invariant. We then define the corresponding 
quenched Gibbs specification by Definition 2.8 using the notation 


hlMiB) := 




( 6 . 1 ) 


Here we do not make the defining potential explicit anymore in order not to overburden 
notion. The measures (3.1) are also called more loosely quenched finite-volume Gibbs measures. 
Obviously, the finite-volume summation is over a a € E^. 
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The second ingredient of the quenched model is the distribution of the disorder variables 
P((ir/). Most of the times in the theory of disordered systems one considers the case of i.i.d. 
variables, but we can and will be more general here. 

The objects of interest will then be the infinite volume joint measures by which 

we understand any limiting measure of ^{dr])^Wrj\{da) in the product topology on the 

space of joint variables. Of course, there are examples for different joint measures of the same 
quenched Gibbs specification for different spin boundary conditions d. In principle there can 
even be different ones for the same spin-boundary condition d, depending on the sub-sequence. 

For all of this the reader might think of the concrete example of the random field Ising 
model. Here the spin variables ax take values in {—1,1}. The disorder variables are given 
by the random fields r]x that are i.i.d. with single-site distribution Pq that is supported on 
a finite set Tfo and assumed to be symmetric. The defining potential <I>(it, r/) is given by 
<h{a,,/}(iT,r/) = —fiaxay for nearest neighbors G Z*^, = —hrjxax, and = 0 else. 

6.2 Relative entropy for joint measnres 

For the first result we do not need the independence of the disorder field. In fact, without any 
decoupling assumption on P we have the following. 

Theorem 6.2 Denote by and K^' two joint measures for the same quenched Gibbs spec¬ 
ification p,\\rj\{da), obtained with any two spin boundary conditions d (and d' respectively), 
along any subsequences Atv (and respectively). Then their relative entropy density van¬ 
ishes, i.e., h{K'^\K'^') = 0. 

Remark 6.3 Note that we are more general than in the usual set up and we do not need to 
assume translation invariance, not even of the defining potential <I>. 

Remark 6.4 This result is neither directly related to the first part nor to the second part 
of the variational principle. It does not yield the first part (which will be proved differently) 
because it is not clear that every measure that is compatible with the same specification as 
can he written in terms of . Applied to the random field Ising model in Section 6.3, this 
result will disprove the second part of the variational principle for weakly but not almost Gibbs 
measures. 


Proof. We have from the definition of the joint measures as limit points with suitable sequences 
of volumes 


K^jaAdA) ^ limArA:X^(o-Ar?A) ^ limAf J F{dfj)ly^dAj^ [fj] (a a ) 

K^'icTAdd) limAT (<ta?7a) limw J ¥{dd)lyt^iTf(^[fi\{aA) 


Here and later we will write in short 1,;^ for the indicator function of the event that the 
integration variable fj coincides with the fixed configuration g on A. We have from the finite 
range of the disordered potential that 


\^{^A{crg) - 4>a(o-V)) 

a-r}=o-'if on A' ^ 


< Gi|9A| 


21 



for cubes A with some finite constant Ci. By dh we mean the r-boundary of A, where r is 
the range of So we get that for N large enough 

e"2*^il^Ai/rX[?/A’?zrf\A](<^A) < AAjv[^Ar?z^\A](o-A) < e^'^^'^'^'AA[^A%^\A](o-A) 

for any joint reference configuration Ar?. This gives the upper bound on the r.h.s. of 

(|6.5D , by application of the last inequalities on numerator and denominator of for the 
same reference conhguration. 

This implies for the finite-volume relative entropy an upper bound of the order of the 
boundary, i.e., 


hK{K~^\K^') = Y, i^"KhA)log 

O-AVA 


K^jaAVA) 

K^'{aAr]A) 


< 4Ci|5A|. 


From that clearly follows the claim h{K"\K^ ) < limsup^^oo p^/iA„(A'”'|Ar'^ ) 
{An)n£N a sequence of cubes. 


0 for 


Also the next theorem can be proved in a natural way when we relax the independence 
assumption of the a priori distribution P of the disorder variables. It says that the property 
of being asymptotically decoupled carries over from the distribution of the disorder fields to 
any corresponding joint distribution. Following |^], we give the following 


Definition 6.6 A probability measure P G is called asymptotically decoupled (AD) if 

there exists sequences pn, Cn sueh that 

lim = 0) li™ — = 0 

n-i-oo |A^| n^oo n 

and for all A G .Pa„, B G Aa^^^ with P(A)P(i?) ^ 0.' 


e,, < n B) 
- ¥{A)¥{B) 


< e^". 


(6.7) 


Theorem 6.8 Suppose P is asymptotically decoupled with functions pn and Cn- Assume that 
is a corresponding translation invariant joint measure of a quenched random system, with 
a defining finite range potential. Then is asymptotically decoupled with functions g(^ = pn 
and c'n = Cn + CIcIA^I, where C is a real constant. 


Proof. It suffices to show that for any finite V C we have 

K{f.Ar,Cv) K{aA„VA„cTvVv) 


< 


K{UjK{(v) K{aAnmn)K{avPv) 
We only show the upper bound. It suffices to show 


< e^ 


lim sup 


Kl [aA^PAr^crvnv) 

Kl (aA„pAjKlJavPv) 


< 


\N 7ViV 

for any sequence A at. The quantity under the limsup equals 

fF{dp)l-nv[v] <^v) 


f P(dpi)lr,j,^ pI [pi] (o-A„ ) / P(di72)lr,v/^i„ [%] ■ 


(6.9) 


( 6 . 10 ) 
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Look at the term under the disorder-integral in the numerator. We have by the compatibility 
of the quenched kernels that 


< 


^^V\ (An uy) ] (1 ) 

J ^Ajv VV'nZ<i\{Ar,UV)] {dd) lo-y /^An [^A„ W%‘^\(AnUy)] (lo-An ) 

e2‘^l|^A"l;i^^[,?Anf/Z'i\An](f^An) X [?/An W \ (An UV ) ] ( ) 


where the inequality follows from the uniform absolute convergence of the quenched potential, 
for any reference configuration itt}. 

We use that 


> e ^^^'^^"*MAn[^An%rf\An](^An) 

and the similar lower bound on the first disorder-integral in the denominator of ( |6.10 ) with 
the same reference joint reference configuration ar). From this we get an upper bound on 
(El) in the form of 


I ^(dm ) 1»?A„ / ^(d'n2 ) Iriv [V2] {(TV ) 

Last we need to control the influence of the variation of the random fields inside the finite 
volume ryA„ on the Gibbs-expectation outside. We have that 

for any configurations r] and inside A„. This gives the following upper bound on ( |6.11 ) 

g8Ci|9A„|_ J ^idfj)lri^^ Irjy 

jF{dfn)lrj^^ /P((ir?2)V' 

But this, by the property of asymptotic decoupling of the disorder field, is bounded by 
g8Ci|9A„|-i-c„ proof of the upper bound in ( |6.9D is done. The proof of the lower 

bound is similar. I 


Applying Pfister’s theory |27], we have 


Corollary 6.12 Suppose P is asymptotically decoupled and that is a corresponding trans¬ 
lation invariant joint measure of a quenched random system, with a defining finite range 
potential. Then h{K\K^) exists for all translation invariant probability measures K. 

Moreover we have the following explicit formula: 
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Theorem 6.13 Suppose that the defining potential $(it, r/) is translation invariant and that 
P is asymptotically decoupled. Suppose that is translation invariant joint measure con¬ 
structed with the boundary condition d. Suppose that K is a translation-invariant measure on 
the product space. Denote by its marginal on the disorder variables p. Then 


h{K\K^) = h{Kd\F) - h{K) - h{Kd) 

+ = +i^(lim^logZX(77 = -)) 


where h{K) is the Kolmogorov-Sinai entropy (2.15). 


Remark 6.14 The third term has the meaning of the K-expectation of the ‘joint energy’. 
The last term is the K-mean of the “quenched pressure”. Note that it is boundary condition 
d-independent, of course. 


Remark 6.15 In the case that F is a Gibbs distribution, the existence of the relative entropy 
density is obtained directly, i.e., without relying on Pfister’s theory. 


Proof. We have 

■^hA{K\K‘^) = X] ^(f^Ar/A)logK(cJAr/A) “ X] K{aAgA)\ogK‘^{crAgA) 
II II o-aVA ' ' ^AVA 

where the first term converges to —h{K). For the second term we use the approximation 


sup 

a’,(T,i7 


log 


K^^ioAPA) 


IP(f/A)MA[f?Af?zd\A](f^A) 


< 2Ci|aA|. 


First we have 

“m A'((TAr?A)logP(??A) = -^hAiKfiF) -Kd{vA)log Kd{r]A)- 
I I f^AUA II I I »?A 

The second term converges to h{Kd). The first term converges to h{Kd\F). This is clear either 
by the classical theory for the case that P is Gibbs or even independent, or by Pfister’s theory 
if P is asymptotically decoupled. Next, by definition 

\ogpffiriAflid\A]{^d) = - Y ^AicfAdidx^AhdhzfiA) - log^A(^Af?Z'i\A)- 

A:AnA7^0 

Using translation-invariance of the measure K we get that the application of ^ J" Kt^daAdrjA) 

over the first sum of the r.h.s. converges to — = ■))■ To see that 

the average over the last term converges we use the ergodic decomposition of Kd to write 
Kd{dr]) = f p{dK)K{dr]) where p{dK) is a probability measure that is concentrated on the 
ergodic measures on p. Fix any ergodic k. For K-a.e. disorder configuration p we have the 
existence of the limit — limA |^logZX(r/ = •)) by standard arguments |^]. The convergence 
is also in , by dominated convergence. So we may integrate over p to see the statement of 
the theorem. ■ 
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6.3 Discussion of the first part of the variational principle for joint measures 


To discuss the first part of the variational principle we will use an explicit representation of the 
conditional expectations of the joined measures. For this we need to restrict to the case that 
P is a product measure. First, in the situation detailed below, we prove the first part of the 
variational principle by direct arguments. Next, we illustrate the criteria given in the general 
theory of Section 3.4 by showing that they can be verified in the context of joint measures in 
the almost Gibbsian case, giving then an alternative proof of the variational principle. 


We start with the following proposition of |]^]. 


Proposition 6.16 Assume that ¥ is a product measure. Assume that there is a set of real¬ 
izations of rj’s of¥-measure one such that the quenched infinite-volume Gibbs measure pL\rj\ 
is a weak limit of the quenehed finite-volume measures {6A_). Then, a version of the infinite- 
volume conditional expectation of the corresponding joint measure K^{da,dr]) = F{dr])fj,[r]]{da) 
is given by the formula 




^ann,^aA(^A) 


f (diiA)QA(hA, VA, m-) 


(6.17) 


Here is the trivial annealed local specification given by in terms of the potential 

U^™{a,ri) = < 1 >^((T, ry) — logPo(^?x) w.r.t counting measure on the produet space. 

Further we have put 


where 


QliVA^vhvA-) = h[VAVA-]{e ^^AGi,r;i,r,aA)) 

A{ri\, rii, gA-){<y) = ^ (^4>yi(a, ryj^r/Ac) - ry^ryA^) • 


According to our assumption on the measurability on pi{rj\, depends measurably on rjA^- 
We fix a version of the map and define the r.h.s. of ( |6.17| ) to be the specification 7 ^. Note that 
for the random field Ising model, this specification exists for all random field configurations 
by monotonicity. 

In this context we always have the first part of the variational principle. Note that we do 
not need any further assumption about almost Gibbsianness. 


Theorem 6.18 Assume that ¥ is a product measure. There exists a constant C depending 
only on ^, ¥ sueh that for any K, K' G one has 


sup 


log 


Ki^A) 


K'i^A) 


< C|5A|. 


In partieular h{K\K') = h{K'\K) = 0. 


Proof. Using K,K' € it suffices to show that we have the estimate 


7a(^aI^a-) ^ c|aA| 

7^((eAie)v.) - 


25 











where the constant C is independent of From the explicit representation (6.17) we 

obtain 


7A(CA|gA^) ^ ^ann,gaA^^^^ j i)A, 7 ]'^,) 

7a(?a|^A-) //^A™’^®'^(^^A)QA(??A,hA,??A-) 


Using the definition of and using the finite range assumption on <1>, we obtain the 

bound for the first factor on the r.h.s. of ( |6.19| ). The second factor on the r.h.s. of 

(|6.19|) is bounded by 


/ ^ QA(??A,hA,hAc) \ f fjA,r]Ac) 

\vF QA(^A>^A,hA 0 / f fl^^^’^^'^(dfjA)Q^(rjA,fjA,rfA<=) 


Using the same argument on again, we see that the second factor is bounded by 

gC|9A|_ rj,^ estimate the first factor, remind the explicit expression 


QAidA,VA,VA^) = //[f/AhA'^] (e 

< e=l^^l^[7?Ar/A-] . 

Here the inequality follows from the definition of Ha and the finite range property of $. Now 
use the definition of the quenched kernels and once again the finite range of to see that the 
last expectation is bounded from above by 


This hnishes the proof. 


Let us now check what can be said about the criteria for the first part of the variational 
principle for joint measures. It turns out that it is natural to use the criteria given in Section 
3.4 with a measure A that is not a Dirac measure. Instead, let us take any translation invariant 
configuration cr° and put A ;= P (8) S^o. 


First, using the arguments given in the proof of Theorem 6.12, it is simple in this situation 
to see that the limit (3.15) exists and to give an explicit expression for it. 


Proposition 6.20 Suppose that the defining potential is translation invariant. Suppose 
that is translation invariant joint measure constructed with the boundary condition a. 
Then 

v450 

exists. 


Hf, :={'n€n,r]^ Qxivi,ril,Vzd\x) is continuous Vx, t?^}. 


Put 


then we have that ap € D.yM 47 ?/ € Assume that PfLf^] = 1. Then any joint measure is 
almost Gibbs. This was pointed out and discussed in the papers jlA, and is apparent from 
the above representation of the conditional expectation. 
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Let us remark that, whenever iL is a translation-invariant probability measure on the 
product space and is any joint measure with marginal K^{dri) = ¥{dr]) we have that 
Kd{dr]) 7 ^ ¥(dr]) h{K\K^) > 0. This is clear from the monotonicity of the relative entropy 

w.r.t. to the filtration. ([0], Proposition 15.5 c). So, h{K\K‘^) = 0 would imply that 
h(Kd\F) = 0 which again would imply = P, by the classical variational principle applied 
to the product measure P. So, given a joint measure K^, the class of interesting measures is 
reduced to the ones having the same r/-marginal. 

Proposition 6.21 Suppose that ¥ is a product measure and that 7 ^ is the above specification 
for a translation-invariant joint measure K>^. Suppose that P('lf^) = 1. Take K a translation- 
invariant measure with marginal K^, = P. 

Then condition C’l holds for the measure K, for the above choice of X. 

Proof. We have to check that X{da^drfi)K{da‘^drfi)-a..s a configuration o'<oh<o'^>o^>o ™ 

where for a conhguration cr we have written cj<o = (o'x)x< 0 ) etc. This is equivalent to 
V<od>o ^ IP ® P-a.e. since both A and K have marginal P, and the later is 

immediate because it is a product measure. I 

To illustrate the general theory of Section 3.4 we note the following 


Corollary 6.22 Suppose that F is a product measure and that 7 ^ is the above specification 
for a translation-invariant joint measure . Suppose that P(Lf^) = 1. Take K G Qinvil^) 
with marginal = P. 


Then condition C’2 of Theorem 3.18 is true and hence 


hiKWn = lim i fwidr,) log = 0 


for any translation invariant spin-configuration . 


6.4 Random field Ising model: failure of the second part of the variational 
principle 


Let us now specialize to the random field Ising model. 

For all what follows we will denote by K~^{dadr]) = ¥{dri)fj,~^[r]]{da) the ‘plus-joint mea¬ 
sure’. Here we clearly mean by p.^[r]]{da) = lim^^^d[r/](dcj) the random infinite-volume 
Gibbs measure on the Ising spins. The limit exists for any arbitrary fixed p, by monotonicity. 
Similarly we write K~{dadri) = ¥{dr])fj.~['q]{da). In this situation we have 


Proposition 6.23 Assume that the quenched random field Ising model has a phase transition 
in the sense that fj,'^[ri]{ax = -|-) > iJ~[r]]{ax = +) for P-a.e. rj and for some x G Then 
the joint measures and K~, obtained with the same defining potential are not compatible 
with the same specification. 

Remark 6.24 We already know by Theorem that the relative entropy h(K~^\K~) is zero, 
and thus we prove here that the second part of the variational principle is not valid in case of 
phase transition for the quenched random field Ising model. 
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Remark 6.25 In the so-called “grand ensemble approach” to disordered systems proposed in 
the theoretical physics literature (going back to Morita (1964)) it is implicitly assumed that 
the potential for the joint measure always exists and does not depend on the choice of the 
joint measure for the same defining potential. Here we give a full proof that non-unicity of 
the joint conditional expectations (and necessarily of the corresponding joint potential) really 
does happen, despite of the fact that the joint measures are always weakly Gibbs. It is thus an 
important example of a pathological behavior in the Morita approach in a well-known disordered 
system, in a translation-invariant situation. For a discussion of the problems of the Morita 
approach with the theoretical physics community, see /§, SHI/- 


Proof. The proof relies on the explicit representation of proposition 6.16| for the conditional ex¬ 
pectations of-fC"'' (resp. in terms of/i"'' (resp. p.~). We will show that f 

Let us evaluate both sides on the event B := {rjx = +, Yliy\y-x\=i ~ 

Using proposition |6.16| , it is simple to see that we have in particular for the local event 
rjx = -\- for any configuration a with 'Yliy\y-x\=i formula 

K^iVx = +\crx-'nx‘^) = j H~'~['nx = -,'nx-]iddx)e‘^’^‘^^'^ =: r+(r/^c) 

So we get that 


K 


(B) = j ¥{dg)^+[fi](^ cjy = o) X r+fec) 

y:\y-x\=l 

Define r~(r]x^) as above, but with the Gibbs measure p,~. Then we have 

f K^{dfx-)Kxi-\f.x-)iB) = j F{dfj)iJ,'^[fj](^ Y o-y = o) X r~{fix-). 

y.\y-x\=l 


Now it follows from our assumption that, for P-a.e. configuration fj we have the strict in¬ 
equality r^(rya;c) < r~{fjx<^). But this shows that both measures give different expectations of 
B and finishes the claim. I 


In the following we show from the weakly Gibbsian point of view that and K~ have 
a “good” (rapidly decaying) almost surely convergent translation invariant potential. This 
strengthens the results in where the a.s. absolutely convergent potential is not translation 
invariant. 


Theorem 6.26 Assume that d > 3, (3 is large enough, the random fields rjx are i.i.d. with 
symmetric distribution that is concentrated on finitely many values, and that hFr((. is suffi¬ 
ciently small. 

There exists an absolutely convergent potential that is translation invariant for the plus 
joint measure K^{dadr]) for sufficiently low temperature and small disorder. It decays like a 
stretched exponential. 


Proof. Applying the remark given after (5.5) that rely on Theorem 2.4. of |]^] we have the 
following. 


Fact proved in [18]. 
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Assume that = F{dr])fi[r]]{da) is a joint measure for the random field Ising model. 

Denote the disorder average of the quenched spin-spin correlation by 

c(m) := sup 

x,y.\x-y\=m 

Suppose we give ourselves any nonnegative translation invariant function w{A) giving weight 
to a subset AcTj^. 

Then there is a potential U^{r]) on the disorder space satisfying the decay property 

/ CX) 

nd„)m{„)\<c\+c,Y, ^w{m)c{m) 

m=2 

if the r.h.s. is finite. Here w{m) := w ({2 € z > 0, \z\ < m}) where > denotes the lexico¬ 
graphic order. Ci,C 2 are constants, depending on P,h. If is translation invariant, then 
U^{r]) is translation invariant, too. The total potential r])+U^{rf) is a potential for 

Here is a potential for the formal Hamiltonian —(3 J2<i j> loglP’o(^i)- 

It was already stated in |Q that we expect a superpolynomial decay of the quantity c{m) 
with m, when m tends to infinity. We remark first that it was already stated and proved in 
Bricmont and Kupiainen (1988) that \fi[r]]{axCry) — fi[r]]{ax)fJ-[r]]{cry)\ < -^vrith 

a random constant C{r]) that is finite for P-a.e. rj. The problem is that integrability of the 
constant is not to be expected. Unfortunately, Bricmont and Kupiainen (1988) do not control 
explicitly in their paper the decay of the disorder average c(m). Now we will reenter their 
renormalization group proof and sketch how stretched exponential decay is obtained for c{m). 
Obviously, we cannot repeat the details of the RG analysis here. For a pedagogical exposition 
of the RG for disordered models, see also |3| where the example of an interface model was 
treated. 

Corollary 6.27 (From There is an exponent a > 0 sueh that, for all m sufficiently large 
we have that 

c{m)<e-^\ (6.28) 


/' 


F{dr]) p.[ri\{a^ay) - p.[ri\{a^) ^i[r]\{ay) 


Sketch of proof based on RG: 

For the first part we follow Bricmont and Kupiainen (1988), page 750, 8.3 ‘Exponential 
Decay of Gorrelations’. Fix x and y. We will be interested in sending their distance to infinity. 
Let us denote by Hc.U^ the half space H \= {z ^ l/', e • z < a} for o > 0, where e is a fixed 
unit vector. Let us denote by •= ^7 monotonicity we have for any 

configuration of random fields r] that the quenched expectation of the spin at the origin in the 
measure [??] is bigger than that in the measure 

Repeating the FKG-arguments given in the first steps of Bricmont and Kupiainen (1988), 
Chapter 8.3., it is sufficient to show stretched exponential decay of the quantity 

j P(dr/)(^^+[r/](o-o) - h'^[n]{cro)^ 


29 




as a function of d{H^, 0) to prove ( 6.2S ). As in we denote by Eh the “good” event in spin- 
space in all of Z'^ that there is no Peierls contour around 0 in that touches the complement of 
H. Then, in the same configuration rj, we have that the r.h.s. is bounded by 


Now, we can always estimate this expectation as a sum over probabilities of Peierls contours 

7:int790 

mtn Jf ^ 57 ^ 0 

The problem is that there is no uniform Peierls estimate for all configurations of the disorder. 
There is however a “good event” in disorder space G = Gh such that there really is a 
Peierls estimate for all the “long” contours appearing in the above sum. The P-probability 
of the complement of this event is small and controlled (in a very-nontrivial way) by the 
renormalization group construction. For r] G Gh we really have that 

7:llltj790 
lilt 7 n/f^ 0 

This is stated as (8.34) in Q. So we have that 

J ¥{dTj)fi+[r]]{E'^) < P(G^) + 

From the construction of the renormalization group in Bricmont-Kupiainen we can see that 
G is expressable in the so-called bad fields N^(? 7 ) in the form G = { 7 , N^( 7 ) = 0 V|x| < 
L, \/k > T is a fixed finite length scale (the block-length suitably chosen in the 

construction of the RG). It appears here just as a constant, x G Z*^ runs over sites in the 
lattice and fc is a natural number denoting the fc-the application of the renormalization group 
transformation. The renormalization group gives the probabilistic control of the form 

P(N^(r?) ^ 0) < 

with some ri > 0 (this follows from Q Lemma 1 and Lemma 2, page 563) and so we have 

P(G^) < 

j iogd(0,g7 
log L 

for d{0, H^) sufficiently large with ri > r 2 > 0. This proves the claim. I 
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